Very high VRAM + RAM usage with XL models during highres fix or adetailer processing

[zethriller]

Looking for tips about this one, anything appreciated.
Even on single image batches, when basic generation steps are complete and highres or adetailer starts, vram raises from about 10-11 GB with an XL model to full VRAM (16 GB) + full shared memory (16 GB in ram - at this point total ram used is close to 80%) for a minute or more, slowing down generation a lot. Then when progress bar of each appears in the console after a good minute, the extra memory use is cleared.

For highres fix: usually going with 4xUltrasharp, 832x1216 or the opposite, 1.5x upscale (=1248x1824)
For adetailer: face_yolov8n or mediapipe_face_full (the latter seem a bit better)

Note it does that on SD 1.5 models, just much less noticeable.

Startup options: --xformers --no-half-vae --gradio-img2img-tool color-sketch --api --update-check

Example generation settings:

Pretty female archer, japanese, scarlet hair, (((full body)) high tech black bodysuit), black tight pants, quiver with arrows, (bow aiming), gathering focus, rainforest, mist, mountains, (relaxing, empowering) atmosphere, detailed face, detailed hair, detailed skin, best quality, illustration, masterpiece, ultra detailed, ultra high res, sharp focus

Negative prompt: (((amputation))), average, bad, ((bad art)), ((bad_anatomy)), bad_hands, bad_perspective, bad_proportions, bad_quality, badly_drawn, blur, blurry, body out of frame, boring, broken_finger, canvas frame, censored, claw, claws, cloned face, cross-eye, deformation, ((deformed)), ((description)), disconnected, disconnected limbs, ((disfigured)), disgusting, distorted hands, distortion, double hands, doubled face, dull, ((duplicate)), elves_ears, error, extra_arm, extra_digit, extra_feet, extra_finger, extra_leg, extra_limbs, fault, fewer_digits, ((floating limbs)), ((frame)), fused_feet, fused_fingers, fused_limbs, gross proportions, grayscale, ((inaccurate body)), jpeg_artifacts, jpg_artifacts, ((logo)), long_feet, long_hand, long_neck, low_detail, low_quality, low_resolution, lowres, malfomed arms, malformed hands, malformed legs, (malformed limbs), mediocre, misplaced, missing_arm, missing_feet, missing_finger, missing_hand, missing_leg, missing_limbs, ((morbid)), (((mutated))), mutated hands, ((((mutated hands and fingers)))), mutated_hand, ((mutation)), ((mutilated)), no_detail, no_quality, no_resolution, noise, nonsense, normal_detail, normal_resolution, obese, out_of_frame, overlay logo, ((poorly drawn eyes)), ((poorly drawn face)), ((poorly drawn feet)), ((poorly drawn hands)), ((poorly drawn mouth)), poorly_drawn, random, rushed, scribble, (((signature))), (swapped feet and hands), ((text)), ((title)), (too many fingers), ugly, unfinished, uninteresting, watermark, watermarked, wrong, ((3girls)), ((multiple girls)), ((1boy)), ((1man)), lens flares, ((nipples)), ((heels)), ((heterochromia)), (((make-up))), ((blush)), ((blushing)), (doll), (doll face), skin spots, freckles, acnes, skin blemishes, age spot, double navel, scar, (muted arms), ((hused arms)), ((hused legs)), ((wings)), ((antenna)), ((big breasts)), (elf ears), (pointy ears), (red eyes), (selfie), ((catgirl)), silhouette, ((window frame)), asymetrical armor, ((simple background)), ((hat)), helmet, horns, (wand), ((sword)), ((weapon)), ((holding weapon)), (staff), (cape), [corset], (hood), (mask), (scarf), ((naked shoulders)), holding clothes

Steps: 30, Sampler: DPM++ 2M Karras, CFG scale: 7, Seed: 1432703765, Face restoration: CodeFormer, Size: 1216x832
Model: sdxlNuclearGeneralPurposeSemi_v10, VAE: sdxl_vae.safetensors, Denoising strength: 0.3,
ADetailer model: mediapipe_face_full, ADetailer confidence: 0.2, ADetailer dilate/erode: 4, ADetailer mask blur: 4, ADetailer denoising strength: 0.4, ADetailer inpaint only masked: True, ADetailer inpaint padding: 32, ADetailer version: 23.9.1,
Hires upscale: 1.5, Hires steps: 10, Hires upscaler: 4xUltrasharp_4xUltrasharpV10,
Version: v1.6.0

Typical generation speeds:

100%|██████████████████████████████████████████████████████████████████████████████████████████████████████| 30/30 [00:15<00:00,  1.90it/s]
--[Insert a minute waiting here]--
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████| 10/10 [00:11<00:00,  1.18s/it]
--[Insert a minute waiting here]--
mediapipe: 1 detected.
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████| 13/13 [00:06<00:00,  1.90it/s]

A1111 1.6.0 on a RT 4060 Ti (16 GB VRAM) / driver version 537.13 / 32 GB RAM

Are these issues related ? #6307 #6725 #12273
I've read somewhere mediapipe is cpu-based no matter what unless you recompile it and i don't think i'm good enough to do that. That wouldn't explain highres though...

Thank you

[niky45]

I have noticed something similar when running ADetailer (face_yolov8s), even though I'm using SD.next. I have 16Gb VRAM, generating a batch of 4 or even 6 images (768x1152) works fast and fits neatly into the VRAM, but the moment the ADetailer starts, iteration speed drops and task manager shows it's using "shared GPU memory" (i.e. RAM).

this however wasn't happening yesterday when using a standard 1024x1024 resolution. I need to do more testing to confirm if that's the answer. ... ran another gen at 1024 square, the moment the ADetailer started, gen speed dropped like a rock.

in any case, it seems an ADetailer issue since I'm using a different UI and having the same problem.

note I'm not using HiRes/refine pass.